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ABSTRACT 


A  small  number  of  rocket  boosters  are  to  be  deployed  in  a  military 
system  on  a  standby  basis.  The  system's  performance  specifications 
require  that  in  time  of  need  at  least  Q  missiles  fire  successfully 
with  y  probability.  The  reliability  of  these  missiles  is  not  known  for 
certain,  but  is  described,  by  the  analyst,  in  terms  of  a  subjective 
unimodal  probability  distribution. 

A  technique  is  described  in  this  report  to  provide  the  answer  to  two 
questions  that  can  be  raised  about  the  situation  described  above: 

1)  With  existing  information  about  the  booster,  what  is  the 
required  deployment  quantity  to  meet  performance 
specifications  ? 

2)  Is  it  expected  that  missile  test  firings  to  increase  knowledge 
of  missile  reliability  will  reduce  deployment  costs  sufficiently 
to  more  than  offset  test  firing  costs  ? 
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ECONOMICS  OF  INCREASING  KNOWLEDGE 
ABOUT  MISSILE  RELIABILITY 

SECTION  I 
INTRODUCTION 

A  small  number  of  rocket  boosters  are  to  be  deployed  in  a  military  sys¬ 
tem  on  a  standby  basis.  The  system's  performance  specifications  require 
that,  in  time  of  need,  at  least  Q  missiles  fire  successfully  with  y  probability. 
The  reliability  of  these  missiles  is  not  known  for  certain.  Nevertheless,  the 
analyst,  on  the  basis  of  expert  opinion,  is  able  to  describe  the  reliability  in 
terms  of  a  subjective  unimodal  probability  distribution, 

A  technique  is  developed  which  incorporates  the  system  performance 
specification  and  the  assumed  prior  distribution  to  answer  the  following  two 
questions: 

1)  What  is  the  number  of  missiles  which  must  be  deployed  to  meet  the 
performance  specification  on  the  basis  of  the  above  distribution  with 
no  test  program  to  acquire  additional  information? 

2)  If  test  firings  are  conducted,  will  the  increased  knowledge  about  the 
actual  missile  reliability  reduce  the  expected  deployment  cost  by  an 
amount  more  than  the  additional  costs  of  testing  ? 

The  sequential  testing  procedure  proposed  allows  the  decision  to  cease 
further  tests  to  be  made  at  any  time  that  the  expected  value  of  the  information 
realizable  from  the  next  test  is  less  than  the  incremental  testing  cost. 

Section  II  presents,  for  illustrative  purposes,  a  statement  of  the  problem 
with  a  hypothetical  set  of  parameters.  Section  III  offers  the  general  solution, 
and  Section  IV  solves  the  h}q)othetical  problem.  An  author's  comment  appears 
in  Section  V. 
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Sl'XTION  II 
THE  PROBLEM 

2, 1  Deployment 

The  performance  specifications  of  a  military  system  employing 
rocket  boosters  on  a  standby  basis  require  that,  in  time  of  need,  the  probability 
that  at  least  three  of  the  boosters  will  fire  successfully  is  95  percent.  Missile 
experts  have  not  had  sufficient  experience  with  the  booster  to  know  its  exact 
reliability  figure,  but  believe  0.  6  is  the  most  likely  value,  and  are  80  percent 
confident  that  the  reliability  lies  between  0.40  and  0.  75.  With  this  information, 
it  is  necessary  to  determine  the  number  of  missiles  that  should  be  deployed  to 
meet  performance  requirements. 

2.  2  Initial  Test  Firing 

Because  of  all  the  costs  accompanying  the  deployment  of  each  missile 
over  the  life  of  the  system,  a  deployed  missile  is  estimated  to  cost  twice  as 
much  as  one  which  is  test-fired.  Since  greater  knowledge  of  the  missile's 
reliability  might  reduce  the  deployment  required  to  meet  performance  speci¬ 
fications,  the  question  is  raised  as  to  whether  a  single  test  shot  would  more 
than  pay  for  itself  in  terms  of  reduced  deployment  costs. 

2.  3  Subsequent  Test  Firing 

After  test  firings  have  been  conducted,  yielding  successes, 
the  question  again  can  be  posed  as  to  whether  one  more  test  shot  would  be 
economical. 
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SECTION  ni 
GENERAL  SOLUTION 


3. 1  Notation 

As  a  convenience  is  solving  the  problems  discussed  in  the  preceding 
Section,  the  following  list  of  variables  will  be  employed: 

expert  opinion  of  most  likely  value  of  reliability 

R  the  difference  between  the  upper  and  lower  bounds  to 

Q 

the  80  percent  confidence  ranges  for  reliability 
P^(r)  the  prior  probability  distribution  for  reliability 

P  (r)  the  posterior  probability  distribution  for  reliability, 
given  one  successful  test  firing 

Pp(r)  the  posterior  probability  distribution  for  reliability, 
given  one  unsuccessful  test  firing 

D  the  required  number  of  deployed  missiles  to  meet  system 
specifications,  given  no  test  firings 

D  the  required  number  of  deployed  missiles,  given  one 

g 

successful  test  firing 

Dj,  the  required  number  of  deployed  missiles,  given  one 
unsuccessful  test  firing 

total  cost  incurred  when  a  missile  is  test-fired 

Cp  total  system  cost  associated  with  procuring  and  deploying 

a  missile 

the  ratio  of 

Q  the  required  minimum  number  of  missiles  to  be  successfully 
fired  with  some  probability  of  meeting  system  specifications 

y  the  probability  demanded  by  system  specifications  that  at 
least  Q  missiles  will  be  successfully  fired 
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parameters  of  the  beta  probability  density  distribution 
of  the  form 


r(a  +  b) 


(l-r)"-*  =  (r;  a,  b) 


a  ,  bgia^,  b^  parameters  of  the  beta  function  given  no  test  firing, 
one  successful  test  firing,  and  one  unsuccessful  test 
firing,  respectively 

N,  n,  k,  X  parameters  of  the  Hypergeometric  probability 
distribution  of  the  form 


c"  cf-" 

X  k-x 


^HYPER 


N  ,  n  ,  k  ,  X 
0  0  0  0 


where 


1  1. 

C.  =  — for  i  >  j 
J  J'.  (i-j)'. 


parameters  of  the  hypergeometric  function  given 


Ng,ng,  kg,Xg  no  test  firing,  one  successful  test  firing,  and 
one  unsuccessful  test  firing,  respectively 

''WVf 


P„(S) 


Pg(S) 


the  probability  distribution  of  the  number  of  deployed 
missiles  which  will  be  fired  successfully,  given  D 
are  deployed,  and  a  and  b  as  the  parameters 
of  the  prior  Beta  disFribution°for  the  missile  reliability 

equivalent  to  P  (S),  but  for  a  ,  b  ,  and  D 

O  o  o  o 


P^(S)  equivalent  to  P  (S),  but  for  a  ,  b  ,  and  D 
F  o  p  r  r 
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3.  2  The  Prior  Distribution  of  the  Reliability’ 

It  will  be  assumed  that  the  prior  distribution  of  the  reliability  can 

be  satisfactorily  represented  by  a  beta  distribution.  *  In  this  case,  Appendix 

A2  of  Reference  3  demonstrates  how  R,  and  R  can  be  used  to  calculate  the 

1  c 

two  parameters  of  the  Beta  function.  The  calculation  requires  the  simultaneous 
solution  of  the  following  equations: 

(0.007  +  0.38R  )  - -  =  variance  (1) 

^  (a  +b  )“  (a  +  b  + 1 ) 

O  0  0  o 


a  - 1 

R  =  — — - 
1  a  +b  -2 
o  0 


(2) 


Subsequent  computatione  are  simplified  by  approximating  and  b^  by  use 
of  the  nearest  integral  values. 

3.  3  The  Posterior  Distribution  of  the  Reliability 

Reference  1**  shows  that  a  prior  beta  distribution  supplemented 
by  sample  information  from  a  Bernoulli  process  produces  a  Beta  posterior 
distribution.  Thus 


'  *'beta  <'■'  “s’  ‘■s’ 


where  =  a  +  1, 
S  0 


(3) 


See  Reference  1  for  a  discussion  of  the  adequacy  of  this  assumption, 
pp.  43-76. 

Ibid. ,  p.  263. 
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^'bETA  ^F’ 


(4) 


where  =  a  ,  =  b  +1. 

F  0  F  0 


3.4  The  Distribution  for  Successfully  Fired  Deployed  Missiles 

Reference  1*  shows  that  the  distribution  for  successfully  fired 
deployed  missiles,  given  their  reliability  is  represented  by  a  beta  distribution, 
will  be  a  "beta-binomial  mass  function."  The  cumulative  form  of  the  latter 
can  be  expressed  as  a  cumulative  hypergeometric.  Reference  1*  demonstrates: 


(5) 


where 


N  =  a  +  b  -1  +  D  =  A  +  D 
0  0  0  0  0  0 


n  =  D 
0  o 


(5a) 


k  =  Q  +  a  -  1 
0  o 


=  V''s> 


(6) 


where 


"s'°s 


(6a) 


Ibid. ,  pp.  265  and  238. 


k.  =  k  +  1 
S  o 
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P  (S  <  Q)  =  P  (x 

^ '  HYPEJi  ^ 


(7) 


v/here 


=  A  +  1  + 

F  o  F 


=  Dt. 
F  F 


(7a) 


k 

0 


To  find  D  ,  D  ,  and  D  it  is  necessary  to  consult  cumulative 
Ob  r 

Hypergeometric  tables*  to  locate  a  compatible  set  of  parameters  that  will 
yield  a  cumulative  probability  of  1  -  y  . 

3. 5  Cost  Savings  from  Test  Firing 

The  expected  number  of  successes,  E(r),  from  a  Bernoulli 
trial  of  size  n  where  the  probability  of  success  is  represented  by  a  beta 
distribution  (with  parameters  a^,  b^)  equals:** 


na 


E(r)  = 


_ o_ 

a  +  b 


0  0 

For  n  =  1,  E(r)  equals  the  probability  of  a  success, 
cost  with  one  test  firing  is;*** 


Hence,  the  expected 


C 


D 


a  b 

o  ^  0 

a  +  b  S  a  +  b 
0  0  0  0 


+ 


Reference  2. 

Reference  1,  p.  237. 

***This  expression  should  be  modified  if  the  cost  function  is  nonlinear. 
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which  must  be  less  than  the  cost  associated  with  deploj-ment  without  a  test 
firing,  .  Thus,  the  relation. 


a  D_  +  b  D 
o  S  0 


a  +  b 


F 


o  0 


<  D 

0 


(8) 


must  hold  if  savings  are  expected  b}'  a  test  firing. 

3.6  Economics  of  the  n+  1th  Test  After  Conducting  n^  Test 
Shots  Which  Yield  r^  Successes 

The  fact  that  a  prior  beta  distribution,  augmented  by  sample 
information  from  a  Bernoulli  process,  yields  a  beta  posterior  was  pointed 
out  in  Paragraph  3 .  3 .  If  n  trials  produce  r  successes,  the  parameters  of 
the  new  beta  become 

a'  =  a  +  r 
0  0 

b'  =  b  +  n  -  r  (9) 

0  0 

The  analysis  described  in  Paragraphs  3. 1  through  3.  5  can  be  repeated  with 
a'  substituted  for  a  and  b'  substituted  for  b  to  determine  whether  the 

O  0  0  0 

n  +  1th  shot  will  yield  an  expected  savings. 
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SECTION  IV 

SOLUTION  WITH  SPECIFIC  VALUES  CITED  IN  SECTION  II 

To  solve  the  particular  problem  described  in  Section  II,  the  variables 
listed  below  take  on  the  indicated  values; 


R  =0.6  R  =0.35  C„  =  0.5  Q  =  3  y=0.95 

1  c  R  ' 

4. 1  Values  for  the  Parameters  of  the  Prior  Distribution 

If  Equations  (1)  and  (2)  are  solved  (or  if  a  set  of  beta  tables*  is 

used)  it  is  found  that  a  =  7  and  b  =5. 

0  0 

4.  2  Determination  of  the  Required  Deployment 

Solution  of  Equations  (5a),  (6a),  and  (7a),  yields: 


N  =  11  +  D  N^  =  12  +  D^  N^  =  12  +  D^ 

0  0  S  S  F  F 


n  =  D 
0  0 


k 

0 


=  9 


=  9 


If  the  cumulative  hypergeometric  tables**  are  consulted  to  determine 
the  smallest  deployment  quantities  that  provide  at  least  a  95  percent  probability 
of  at  least  three  successful  firings,  it  is  found  that; 


D  =  11  D^  =  10  D„=  12 

0  S  r 


* 

Reference  4. 


Reference  2. 
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4.  3  Determination  as  to  Whether  a  Test  Shot  Realizes  a  Cost  Saving 
The  left-hand  side  of  Relation  (8)  becomes 


7.10  +  5.12 
12 


+  0.5  =  11.33 


The  right-hand  side  of  Relation  (8)  is  11.  Therefore,  a  first  test 
is  uneconomic. 
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SECTION  V 
AUTHOR'S  COMMENT 

5. 1  Validity  of  the  Criterion 

The  reader  is  reminded  that  the  approach  presented  in  this  paper 
uses  as  its  optimization  criterion  the  minimization  of  expected  costs.  This 
approach,  therefore,  should  only  be  employed  if  this  criterion  is  acceptable 
to  the  decision-maker.  Reference  1*  discusses  the  use  of  this  criterion. 

5.  2  Sensitivity  of  the  Results  to  the  Prior  Distribution 

The  approach  used  allows  the  analyst  to  insert  his  a  priori  feelings 
into  the  anal3^sis  in  the  form  of  a  prior  subjective  probability  distribution.  If 
the  analyst  experiences  some  uneasiness  in  the  distribution  that  he  specifies, 
he  will  be  well  advised  to  examine  the  effect  of  making  plausible  changes  to 
his  prior  distribution  results. 

5.  3  The  Decision  Not  to  Deploy 

Budgetary  constraints  may  limit  the  total  costs  that  can  be  spent 
on  deployment  and  testing.  Hence,  the  decision  might  be  made  at  the  outset, 
or  at  some  point  during  the  testing  program,  not  to  deploy  the  booster  under 
consideration,  since  the  costs  of  a  sufficient  deployment  to  meet  performance 
specifications  has  too  high  a  probability  of  exceeding  the  budgetary  limitation. 

If  the  budgetary  constraint  and  the  threshold  probability  are  known,  the  de¬ 
cision  not  to  deploy  may  be  determined  as  follows: 

(1)  With  the  original  prior  and  the  results  of  the  tests  which 
have  already  been  conducted,  form  a  new  prior  (see  (9)). 


* 


Chapter  1. 
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(2)  Consider  all  possible  outcomes  from  future  tests  and  follow 
through  each  chain  of  events  until  it  does  not  pay  to  conduct 
an  additional  test  (see  Paragraph  3.6). 

(3)  Determine  the  required  deployment  for  each  chain 
(see  Paragraphs  3. 1  to  3.  4). 

(4)  Compute  the  total  testing  and  deplo3'ment  cost  implied 
by  each  chain. 

(5)  Using  the  prior  generated  in  (1),  find  the  probability  for 
each  chain  (use  expression  for  E(r)  in  Paragraph  3.  5 
and  Equation  (9)  respectively). 

(6)  Identify  those  chains  which  have  costs  in  excess  of  the 
budgetary  constraint,  and  total  their  probabilities  to  see 
if  the  total  exceeds  the  threshold  probability. 


< .  (i  SAi 


S.A.  Sobel 
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